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DETAILED ACTION 



Claim Rejections - 35 USC §103 



1. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1-2, 5-13, 15-18, 20-21, and 23-47 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sethares (US Patent No. 5,504,270) in view of Serra (US Patent No. 
5,536,902). 

Sethares discloses a method and apparatus for dissonance modification to audio signals. 

3. Regarding claims 1, 25, 37 and 43, at Figure 4A and 4B and col. 4, lines 49-52; col. 5, 
lines 24-29 and col. 9, line 35 to col. 10, line 57, Sethares discloses vocal input is passed to an 
analyzer to produce a spectrum of input partials in the form of frequency and amplitude domain, 
which reads on "extracting deterministic components from the input voice signal, the 
deterministic components including a plurality of sinusoidal wave components", since frequency 
and amplitude are forms of sinusoidal wave components. 

Additionally, at Figure 4B, Sethares teaches separating the sinusoidal wave into 
frequency value coordinates and amplitude value coordinates. 

Sethares does not teach the coordinates are numbered sequentially. However it would 
have been obvious to provide for the coordinates to be numbered sequentially, so as to facilitate 
an easy method of storage and retrieval of the coordinates. 
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Additionally, at col. 10, lines 16-17, Sethares teaches the system allows a user to provide 
input timbre information by accessing information stored in the computer database, which reads 
on "memory means for memorizing reference pitch information." 

Additionally, at col. 9, line 35 continuing to col. 10, line 57, Sethares teaches the 
modification of the frequencies of the partials based on a desired pitch or timbre, which reads on 
"modulating means for modulating the frequency value coordinates of the sinusoidal wave 
components." 

Additionally, at col. 10, lines 35-43, Figure 4A, element 16, Figure 4B, and Figure 5, 
Sethares teaches implementation of a synthesizer for mixing the modulated sinusoidal 
components. 

Sethares does not teach extracting only the deterministic components. However, 
implementation of extracting only deterministic components in a synthesizing system was well 
known. 

In a similar field of endeavor, Serra teaches a method and apparatus for analyzing and 
synthesizing a sound by extracting and controlling a sound parameter and implements extraction 
of only deterministic components (col. 10, lines 3-29), for the purpose of generating a synthetic 
waveform of the deterministic component and then reanalyze and reextract the deterministic 
component, which is then subtracted from the magnitude spectra. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the embodiment of Sethares to specifically allow extracting only deterministic 
components from the input signal, as taught by Serra, for the purpose of generating a synthetic 
waveform of the deterministic component and then reanalyze and reextract the deterministic 
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component, which is then subtracted from the magnitude spectra, because such a modification 
would account for more of the residual variations in the data. 

Sethares does not specifically teach modulating amplitude value coordinates or a 
combining means for combining the modulated frequency value coordinates and the modulated 
amplitude value coordinates to synthesize sinusoidal wave components of the output voice signal 
having an output pitch and an output timbre different from an input pitch and an input timbre, of 
the input voice signal, and influenced by a reference pitch and a reference timbre of the reference 
signal. 

Serra teaches a method and apparatus for analyzing and synthesizing a sound by 
extracting and controlling a sound parameter and implements extraction of deterministic 
components such as frequency and amplitude which are used to produce a synthesized output 
signal from mixing or combining the modifying the frequency and amplitude components 
(Figure 3, Figure 5, col. 10, line 44 continuing to col. 14, line 10). Serra teaches that the system 
provides various improvements for sound analysis/synthesis and enhances the practicability of 
the analysis/synthesis (col. 1, lines 8-12; col. 2, lines 37-40). 

Serra does not teach the modification of the frequency and amplitude is achieved via 
modulation. However, implementation of amplitude and frequency modulation was well known. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to implement the frequency and amplitude modulation via the 
component modification techniques of Serra, for the purpose of improving and enhancing sound 
analysis/synthesis as taught by Serra, and thereby improving the overall quality of the audio 
signal modification system. 



'Application/Control Number; 09/1 8 1 ,02 1 Page 5 

Art Unit: 2654 

Regarding claim 2, Sethares and Serra teach everything as claimed in claim 1. 
Additionally, at col. 10, lines 6-51, Sethares teaches implementation of an MIDI controller which 
allows the user to provide input timbre information. 

Regarding claims 5 and 7, Sethares and Serra teach everything as claimed in claim 1 . At 
col. 10, lines 35-43, Figure 4A, element 16, Figure 4B, and Figure 5, Sethares teaches 
implementation of a synthesizer for mixing the modulated sinusoidal components. 

Regarding claim 6, Sethares does not specifically teach a control parameter to control the 
degree of modulation of the amplitude. However, implementation of control parameters for 
various amplitude parameters was well known. 

Serra teaches implementation of user controlled amplitude parameters, such as tilt, for the 
purpose of allowing the user to freely control the parameter to accurately reflect the user's 
intentions (col. 11, lines 11-29). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to implement parameter control of amplitude data, for the 
purpose of allowing the user to freely control the parameter to accurately reflect the user's 
intention. 

Regarding claim 8, Sethares does not specifically teach separating the residual 
component after the sinusoidal components have been extracted. 

Serra teaches (col. 10, lines 3-29) extraction of the frequency and amplitude components 
as the deterministic component and after the components are extracted, the residual or stochastic 
component is obtained. 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to obtain the residual components after the sinusoidal 
components are obtained, to ensure the residual components are determined from a current frame 
to accurately reflect the variation of the input signal. 

Regarding claims 30, 33, 36, and 42, at col. 4, line 49, Sethares teaches implementation 
of Fourier analysis. Sethares does not specifically teach implementation of a peak detecting 
means to extract the sinusoidal components. However, implementation of peak detection 
algorithms in a synthesizing system was well known in the art. 

Serra (col. 10, lines 3-29) teaches implementation of detecting peaks in the magnitude 
spectra and is extracted and is used to obtain the time-series frequency and magnitude 
trajectories. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system to implement detecting peaks in the magnitude spectra, as taught by Serra, 
for the purpose of ensuring the most accurate and essential frequency/amplitude deterministic 
pairs are obtained. 

4. Regarding claims 9, 13, 15, 26, 39, and 45, at Figure 4A and 4B and col. 4, lines 49-52; 
col. 5, lines 24-29 and col. 9, line 35 to col. 10, line 57, Sethares discloses vocal input is passed 
to an analyzer to produce a spectrum of input partials in the form of frequency and amplitude 
domain, which reads on "extracting deterministic components from the input voice signal, the 
deterministic components including a plurality of sinusoidal wave components", since frequency 
and amplitude are forms of sinusoidal wave components. 
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Additionally, at col. 10, lines 13-27, Sethares teaches the implementation of the MIDI 
controller which allows user access to timbre profiles stored in a database, and teaches the 
system allows access to the input and reference partials to modify dissonance, which reads on 
"memorizing means." 

At col. 10, lines 35-43, Figure 4A, element 16, Figure 4B, and Figure 5, Sethares teaches 
implementation of a synthesizer for mixing the modulated sinusoidal components. 

Sethares does not teach extracting only the deterministic components. However, 
implementation of extracting only deterministic components in a synthesizing system was well 
known. 

In a similar field of endeavor, Serra teaches a method and apparatus for analyzing and 
synthesizing a sound by extracting and controlling a sound parameter and implements extraction 
of only deterministic components (col. 10, lines 3-29), for the purpose of generating a synthetic 
waveform of the deterministic component and then reanalyze and reextract the deterministic 
component, which is then subtracted from the magnitude spectra. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the embodiment of Sethares to specifically allow extracting only deterministic 
components from the input signal, as taught by Serra, for the purpose of generating a synthetic 
waveform of the deterministic component and then reanalyze and reextract the deterministic 
component, which is then subtracted from the magnitude spectra, because such a modification 
would account for more of the residual variations in the data. 
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Sethares does not teach the coordinates are numbered sequentially. However it would 
have been obvious to provide for the coordinates to be numbered sequentially, so as to facilitate 
an easy method of storage and retrieval of the coordinates. 

Sethares does not specifically teach modulating amplitude value coordinates or a 
normalizing means for normalizing the amplitude value coordinates of the sinusoidal wave 
components of the input voice signal and a mixing means for mixing the normalized amplitude 
value coordinates of the input voice signal and the memorized amplitude value coordinates of the 
reference voice signal with one another by a predetermined ratio to produce mixed amplitude 
value coordinates and multiplying means for multiplying the normalized amplitude value 
coordinates of the sinusoidal wave components of the input voice signal with the mean amplitude 
of the input voice signal. 

Serra teaches a method and apparatus for analyzing and synthesizing a sound by 
extracting and controlling a sound parameter and implements extraction of deterministic 
components such as frequency and amplitude which are used to produce a synthesized output 
signal from mixing or combining the modulated frequency and amplitude components (Figure 3, 
Figure 5, col. 10, line 44 continuing to col. 14, line 10). Serra teaches that the system provides 
various improvements for sound analysis/synthesis and enhances the practicability of the 
analysis/synthesis (col. 1, lines 8-12; col. 2, lines 37-40). 

Serra does not teach the modification of the frequency and amplitude is achieved via 
modulation. However, implementation of amplitude and frequency modulation was well known. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to implement the frequency and amplitude modulation via the 
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component modification techniques of Serra, for the purpose of improving and enhancing sound 
analysis/synthesis as taught by Serra, and thereby improving the overall quality of the audio 
signal modification system. 

Regarding claim 10, Sethares and Serra teach everything as claimed in claim 9. Sethares 
does not specifically teach a control parameter to control the degree of modulation of the 
amplitude. However, implementation of control parameters for various amplitude parameters 
was well known. 

Serra teaches implementation of user controlled amplitude parameters, such as tilt, for the 
purpose of allowing the user to freely control the parameter to accurately reflect the user's 
intentions (col. 11, lines 11-29). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to implement parameter control of amplitude data, for the 
purpose of allowing the user to freely control the parameter to accurately reflect the user's 
intention. 

Regarding claim 11, Sethares and Serra teach everything as claimed in claim 9. 
Additionally, at col. 10, lines 16-17, Sethares teaches the system allows a user to provide input 
timbre information by accessing information stored in the computer database, which reads on 
"memory means for memorizing reference pitch information." 

Additionally, at col. 9, line 35 continuing to col. 10, line 57, Sethares teaches the 
modification of the frequencies of the partials based on a desired pitch or timbre, which reads on 
"modulating means for modulating the frequency value coordinates of the sinusoidal wave 
components." 
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Additionally, at col. 10 5 lines 35-43, Figure 4A, element 16, Figure 4B, and Figure 5, 
Sethares teaches implementation of a synthesizer for mixing the modulated sinusoidal 
components 

Regarding claim 12, Sethares and Serra teach everything as claimed in claim 11. 
Additionally, at col. 10, lines 6-51, Sethares teaches implementation of an MIDI controller which 
allows the user to provide input timbre information. 

Regarding claim 16, Sethares does not specifically teach separating the residual 
component after the sinusoidal components have been extracted. 

Serra teaches (col. 10, lines 3-29) extraction of the frequency and amplitude components 
as the deterministic component and after the components are extracted, the residual or stochastic 
component is obtained. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to obtain the residual components after the sinusoidal 
components are obtained, to ensure the residual components are determined from a current frame 
to accurately reflect the variation of the input signal. 

Regarding claims 31, 34, 38 and 44, at col. 4, line 49, Sethares teaches implementation of 
Fourier analysis. Sethares does not specifically teach implementation of a peak detecting means 
to extract the sinusoidal components. However, implementation of peak detection algorithms in 
a synthesizing system was well known in the art. 

Serra (col 10, lines 3-29) teaches implementation of detecting peaks in the magnitude 
spectra and is extracted and is used to obtain the time-series frequency and magnitude 
trajectories. 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system to implement detecting peaks in the magnitude spectra, as taught by Serra, 
for the purpose of ensuring the most accurate and essential frequency/amplitude deterministic 
pairs are obtained. 

5. Regarding claims 17, 23, 27, 28, 29, and 41 at Figure 4A and 4B and col. 4, lines 49-52; 
col. 5, lines 24-29 and col. 9, line 35 to col. 10, line 57, Sethares discloses vocal input is passed 
to an analyzer to produce a spectrum of input partials in the form of frequency and amplitude 
domain, which reads on "extracting deterministic components from the input voice signal, the 
deterministic components including a plurality of sinusoidal wave components", since frequency 
and amplitude are forms of sinusoidal wave components. 

Additionally, at Figure 4B, Sethares teaches separating the sinusoidal wave into 
frequency value coordinates and amplitude value coordinates. 

Sethares does not teach the coordinates are numbered sequentially. However it would 
have been obvious to provide for the coordinates to be numbered sequentially, so as to facilitate 
an easy method of storage and retrieval of the coordinates. 

Additionally, at col. 10, lines 13-27, Sethares teaches the implementation of the MIDI 
controller which allows user access to timbre profiles stored in a database, and teaches the 
system allows access to the input and reference partials to modify dissonance, which reads on 
"memorizing means." 

Additionally, at col. 10, lines 16-17, Sethares teaches the system allows a user to provide 
input timbre information by accessing information stored in the computer database, which reads 
on "memory means for memorizing reference pitch information." 
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Additionally, at col. 9, line 35 continuing to col. 10, line 57, Sethares teaches the 
modification of the frequencies of the partials based on a desired pitch or timbre, which reads on 
"modulating means for modulating the frequency value coordinates of the sinusoidal wave 
components." 

At col. 10, lines 35-43, Figure 4A, element 16, Figure 4B, and Figure 5, Sethares teaches 
implementation of a synthesizer for mixing the modulated sinusoidal components. 

Sethares does not teach extracting only the deterministic components. However, 
implementation of extracting only deterministic components in a synthesizing system was well 
known. 

In a similar field of endeavor, Serra teaches a method and apparatus for analyzing and 
synthesizing a sound by extracting and controlling a sound parameter and implements extraction 
of only deterministic components (col. 10, lines 3-29), for the purpose of generating a synthetic 
waveform of the deterministic component and then reanalyze and reextract the deterministic 
component, which is then subtracted from the magnitude spectra. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the embodiment of Sethares to specifically allow extracting only deterministic 
components from the input signal, as taught by Serra, for the purpose of generating a synthetic 
waveform of the deterministic component and then reanalyze and reextract the deterministic 
component, which is then subtracted from the magnitude spectra, because such a modification 
would account for more of the residual variations in the data. 
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Sethares does not specifically teach modulating amplitude of the sinusoidal wave 
components. However, modifying the amplitude of sinusoidal wave components in a 
synthesizing system was well known in the art. 

In a similar field of endeavor, Serra teaches a method and apparatus for analyzing and 
synthesizing a sound by extracting and controlling a sound parameter and implements modifying 
the obtained frequency and amplitude parameters to generate a desired synthesized output 
(Abstract, col. 11, lines 10-67), for the purpose of improving the musical synthesizer. 

Serra does not teach the modification of the frequency and amplitude is achieved via 
modulation. However, implementation of amplitude and frequency modulation was well known. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to implement the frequency and amplitude modulation via the 
component modification techniques of Serra, for the purpose of improving and enhancing sound 
analysis/synthesis as taught by Serra, and thereby improving the overall quality of the audio 
signal modification system. 

Sethares does not specifically teach modulating amplitude value coordinates or a 
combining means for combining the modulated frequency value coordinates and the modulated 
amplitude value coordinates to synthesize sinusoidal wave components of the output voice signal 
having an output pitch and an output timbre different from an input pitch and an input timbre, of 
the input voice signal, and influenced by a reference pitch and a reference timbre of the reference 
signal. 

Serra teaches a method and apparatus for analyzing and synthesizing a sound by 
extracting and controlling a sound parameter and implements extraction of deterministic 
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components such as frequency and amplitude which are used to produce a synthesized output 
signal from mixing or combining the modulated frequency and amplitude components (Figure 3, 
Figure 5, col. 10, line 44 continuing to col. 14, line 10). Serra teaches that the system provides 
various improvements for sound analysis/synthesis and enhances the practicability of the 
analysis/synthesis (col. 1, lines 8-12; col. 2, lines 37-40). 

Serra does not teach the modification of the frequency and amplitude is achieved via 
modulation. However, implementation of amplitude and frequency modulation was well known. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to implement the frequency and amplitude modulation via the 
component modification techniques of Serra, for the purpose of improving and enhancing sound 
analysis/synthesis as taught by Serra, and thereby improving the overall quality of the audio 
signal modification system. 

Regarding claim 18, Sethares and Serra teach everything as claimed in claim 17. 
Additionally, at col. 10, lines 6-51, Sethares teaches implementation of an MIDI controller which 
allows the user to provide input timbre information. 

Additionally, at col. 9, line 35 continuing to col. 10, line 57, Sethares teaches the 
modification of the frequencies of the partials based on a desired pitch or timbre, which reads on 
"modulating means for modulating the frequency value coordinates of the sinusoidal wave 
components." 

Regarding claim 20, Sethares and Serra teach everything as claimed in claim 17. 
Additionally, at col. 10, lines 6-51, Sethares teaches implementation of an MIDI controller which 
allows the user to provide input timbre information 
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Sethares does not specifically teach modulating amplitude of the sinusoidal wave 
components. However, modifying the amplitude of sinusoidal wave components in a 
synthesizing system was well known in the art. 

In a similar field of endeavor, Serra teaches a method and apparatus for analyzing and 
synthesizing a sound by extracting and controlling a sound parameter and implements modifying 
the obtained frequency and amplitude parameters to generate a desired synthesized output 
(Abstract, col. 11, lines 10-67), for the purpose of improving the musical synthesizer. 

Serra does not teach the modification of the frequency and amplitude is achieved via 
modulation. However, implementation of amplitude and frequency modulation was well known. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to implement the frequency and amplitude modulation via the 
component modification techniques of Serra, for the purpose of improving and enhancing sound 
analysis/synthesis as taught by Serra, and thereby improving the overall quality of the audio 
signal modification system. 

Regarding claim 21, Sethares and Serra teach everything as claimed in claim 17. 
Additionally, at col. 10, lines 6-51, Sethares teaches implementation of an MIDI controller which 
allows the user to provide input timbre information. 

Regarding claim 24, Sethares does not specifically teach separating the residual 
component after the sinusoidal components have been extracted. 

Serra teaches (col. 10, lines 3-29) extraction of the frequency and amplitude components 
as the deterministic component and after the components are extracted, the residual or stochastic 
component is obtained. 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Sethares to obtain the residual components after the sinusoidal 
components are obtained, to ensure the residual components are determined from a current frame 
to accurately reflect the variation of the input signal. 

Regarding claims 32, 35, 40, and 46, at col. 4, line 49, Sethares teaches implementation 
of Fourier analysis. Sethares does not specifically teach implementation of a peak detecting 
means to extract the sinusoidal components. However, implementation of peak detection 
algorithms in a synthesizing system was well known in the art. 

Serra (col. 10, lines 3-29) teaches implementation of detecting peaks in the magnitude 
spectra and is extracted and is used to obtain the time-series frequency and magnitude 
trajectories. 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system to implement detecting peaks in the magnitude spectra, as taught by Serra, 
for the purpose of ensuring the most accurate and essential frequency/amplitude deterministic 
pairs are obtained. 



6. Claims 4, 14, and 22 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Sethares (US Patent No. 5,504,270) in view of Serra (US Patent No. 5,536,902) as applied to 
claims 1, 9, and 17 above, and further in view of well known prior art. 
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7. Regarding claims 4, 14, 22 Sethares and Serra teach everything as claimed in claims 1, 9, 
17. Sethares teaches detecting a pitch of the input signal based on results of extraction at col. 9, 
lines 38-52. 

Sethares does not specifically disclose a switch means for outputting an original of the 
input voice signal in situations in which a pitch is not detected from the input signal. However, 
implementation of a switching mechanism to output an original signal when an input signal 
cannot be analyzed was well known in the art. 

Therefore, it would have been obvious to output an original signal in cases in which a 
pitch is not detected from the input signal to avoid large fluctuations in the pitch of the signal, for 
the purpose of providing for smooth transitions as the parameter information is synthesized and 
reducing the unnaturalness of the synthetic signal. 



Response to Arguments 

8. Applicant's arguments with respect to claims 1-2, 4-18, and 20-47 have been considered 
but are moot in view of the new ground(s) of rejection. 
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9. * Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Angela A. Armstrong whose telephone number is 703-308-6258. 
The examiner can normally be reached on Monday-Thursday 7:30-5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (703) 305-9645. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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Examiner 

Art Unit 2654 
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